i/i 


AD-A140  758  INTERACTIVE  RISK  ANALVSIS  AND  DEVELOPMENT  OF 

STANDARDIZED  FACTORSOI)  PEL  INC  BATON  ROUGE  LA 
G  H  NORM  JAN  84  BRMC-82-5075  F22615-83-K-5B75 

F/G  9/2 


UNCLASSIFIED 


NL 


.«?**>£*  •'  * 


BRMC -83-5075 


INTERACTIVE  RISK  ANALYSIS  AND  DEVELOPMENT  OF  STANDARDIZED  FACTORS 


Dr.  George  H.  None 
Pel,  Inc. 

P.O.  Box  80784 
Baton  Rouge  LA  70898 


January  1984 


Final  Report  for  Period  Covering  1  August  1983  -  31  January  1984 
Contract  No.  F3361 5-83-K-5075 


Prepared  for 
AIR  FORCE  BUSINF' 
Wrlght-Patterso.. 


DTIC 

cLECTEI 

MAY  4  1984* 


D 


Approved  idr  Public  Release: 
Distribution  Unlimited 


84  05  01  072 


SECURITY  CLASSIFICATION  OF  THIS  FAGS 


REPORT  DOCUMENTATION  PAGE 


to.  REPORT  SECURITY  CLASSIFICATION 

UNCLASSIFIED _ 


lb.  RESTRICTIVE  MARKINGS 


H  SECURITY  CLASSIFICATION  authority 


2b.  OECLASSlFICATION/OOWNGRAOlNG  SCHEDULE 


3.  O t ST  R I SUT  ION/ AVAILABILITY  OF  REFORT 

Approved  for  Public  Release: 
Distribution  Unlimited 


4.  PERFORMING  ORGANIZATION  REFORT  NUMBERlS) 


S.  MONITORING  ORGANIZATION  REFORT  NUMBERISk 

BRMC-83-5075 


0.  NAME  OF  PERFORMING  ORGANIZATION 

Pel,  Inc. 


pb.  OFFICE  SYMBOL 
Ilf  applicable) 


7*.  NAME  OF  MONITORING  ORGANIZATION 

Air  Force  Business  Research  Mgt  Center 


Sc.  AOORESS  (City.  Slate  tu>4  ZIP  Code) 

P.0.  Box  80784 
Baton  Rouge  LA  70898 


7b.  ADDRESS  (City.  Stale  and  ZIP  Code) 

Attn:  AFBRMC/RDCB 
Wright-Patterson  AFB,  OH  45433 


Bo.  NAME  OF  FUNOING/SPONSORING 
ORGANIZATION 

Camo  a  a  7 


.  OFFICE  SYMBOL 
(If  applicable) 


S.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 

F33615-83-K-5075 


Be  AOORESS  (City.  Stale  and  ZIP  Codt) 


10.  SOURCE  OF  FUNOING  NOS. 


11.  TITLE  (Include  Security  CUueificat.oni  (  jj  )  Interact  ive  Risk 

..  Analysis  &  Development  ^Standardised  Factork 


PROGRAM 

TASK 

WORK  UNIT 

ELEMENT  NO. 

NO. 

NO. 

71113 

B 

006 

0 

12.  PERSONAL  AUTHOR(S) 


13b.  TIME  COVERED 

14.  DATE  OF  REPORT  (Yr.  Mo..  Day) 

IS.  PAGE  COUNT  i 

FROM  830801  TO  flAOLU. 

8401 

...H  - _ 

IB.  SUPPLEMENTARY  NOTATION 


17 

COSATI  COOES 

11.  SUBJECT  TEAMS  (Continue  on  rwuonc  if  ncccumry  and  identify  by  block  number) 

FIELD 

GROUP 

SUB.  GR. 

Risk  Analysis,  Cost  Estimating,  Ueapon  Systems,  Computer 
Model 

14 

01 

12 

02 

IB.  ABSTRACT  /Continue  on  reverie  it  ne canary  and  identify  by  btocb  number i 


This  report  consists  of  two  parts — interactive  risk  analysis  and  standardized  factors  for 
risk  analysis. 

a.'^Wrt  I  presents  a  brief  description  of  a  computer  program  which  is  available  to 
perform  calculations  needed  in  a  risk  analysis.  The  program  allows  a  user  to  estimate 
the  risk  associated  with  aw,  number  of  variables  and  to  display  the  distribution  of  any 
arithmetic  (additiofr,  tfuttraction,  an4^»r-niultiplieati-on->-  combination  of  the  variables. 
The  mode  of  operation  is  designed  to  be  similar  to  a  calculator.  Rather  than  entering  in 
a  single  number,  the  user  must  supply  a  low,  most  likely,  and  high  for  each  variable. 
Variables  can  be  added,  subtracted,  or  multiplied;  intermediate  calculations  can  be 
stored;  and  the  distribution  of  the  total  can  be  displayed  at  any  time. 


b.  Part  II  discussed  the  development  of  a  microcomputerized  statistical  price  risk 


20.  OlSTRI BUTION/AVAI LABILITY  OF  ABSTRACT 

21  ABSTRACT  SECURITY  CLASSIFICATION  I 

UNCLASSlFISO/UNLlMITSfiUC  SAMS  AS  RPT.  C  OTIC  USERS  □ 

UNCLASSIFIED 

22a  NAME  OF  RESPONSIBLE  INOIVIOUAL 

22b  TELEPHONE  NUMBER 

22c  OFFICE  SYMBOL 

(Include  Area  Code/ 

Capt  Michael  C.  Tankersley 

513-255-6221 

AFBRMC/RDCB 

DO  FORM  1473, 83  APR  EDITION  OP  1  JAN  73  It  OBSOLETE. 


SECURITY  CLASSIFICATION  OF  THIS  PAGE 


SCCUNITV  CLASSIFICATION  OF  THIS  FAGS 


analysis  model  which  allows  a  user  Co  estimate  a  distribution  of  total  cost  using 
completely  objective  input.  The  objective  characteristics  of  a  contract  which  introduce 
cost  risk  are  identified,  and  the  standardized  factors  associated  with  these  characteris¬ 
tics  are  defined  and  applied  to  a  cost  breakdown.  The  use  of  standardized  factors  has 
several  advantages  over  subjective  estimates  of  risk:  the  cost  risk  analysis  is  objective 
rather  than  subjective;  estimates  of  risk  are  independent  of  biases  and  experience;  risk 
analysis  results  are  comparable  between  contracts;  standardized  factors  provide  documen¬ 
tation  for  the  cost  risk  analysis;  oversights  are  eliminated;  and  standardized  factors 
allow  for  the  incorporation  of  many  different  points  of  view.^^ 


\  O  /  -  I 

\  T 


Accession  For 

V*  ■  s 

□ 

n 

□ 

ir> .all  s. 

. . 

■  «*ar  :  Vs»%  1  :■»/ 

(?  »*  4  >  ?  i 

•  -.1  ft  -  1  — 

; 

SSCUniTY  CLASSIFICATION  OF  THIS  FAGS 


TABLE  OF  CONTENTS 


PART  I  -  Interactive  Risk  Analysis 

Abstract  . 

Introduction  . 

Interactive  Model . 

Example . 

S  unwary . 

References  . 


PART  II  -  Standardized  Factors  for  Risk  Analysis 

Introduction  . 

Standardized  Factor  Model . 

Application . 

Example . 

Sunmiairy . 

References  . 

Appendix  A  . 

Appendix  B  . 


TABLES 

1 

2 

3 

4 


Data  Input  (Most  Likely  Cost).  .  .  . 

Standardized  Factors  . 

Standardized  Factors  (Continued)  .  . 
Application  of  Standardized  Factors. 


£22* 


II 

II-l 
11-2 
1 1-9 
11-11 
11-12 
11-13 
11-14 
11-20 


K 


I 


|A 

I2*-. 


& 


i 


* 


INTERACTIVE  RISK  ANALYSIS 


ABSTRACT 

This  report  presents  s  brief  description  of  s  computer 
progrsa  which  is  available  to  perform  calculations  needed  in 
a  risk  analysis.  This  program  is  one  which  allows  a  user  to 
estimate  the  risk  associated  with  any  number  of  variables  and 
to  display  the  distribution  of  any  arithmetic  (addition, 
subtraction,  and  (or)  multiplication)  combination  of  the 
variables. 

The  mode  of  operation  is  designed  to  be  similar  to  a 
calculator.  Rather  than  entering  in  a  single  number,  the 
user  must  supply  a  low,  most  likely  and  high  for  each 
variable.  Variables  can  be  added,  subtracted,  or  multiplied; 
intermediate  calculations  can  be  stored;  and  the  distribution 
of  the  total  can  be  displayed  at  any  time. 

INTRODUCTION 

Many  point  estimates  of  totals  (e.g. ,  project 
completion  time,  cost  of  weapon  systems,  etc.)  involve  simple 
addition,  subtraction  and  multiplication  which  can  be 
performed  on  a  hand  calculator.  Commonly,  point  estimates  are 
made  for  each  subcomponent  and  totals  are  calculated. 
Problems  arise  when  there  is  a  lack  of  information  or  there 
is  an  inability  to  accurately  forecast  the  subcomponent.  The 
affect  on  the  total  is  captured  by  risk  analysis. 

To  determine  the  amount  of  uncertainty  in  a  total,  an 
analyst  would  not  only  estimate  the  most  likely  value  for 
each  subcomponent  but  also  estimate  the  probability  of 


different  outcomes  for  each  subcomponent.  From  this 
Information,  probabilities  of  different  totals  could  be 
calculated.  This  is  exactly  what  is  done  in  statistical  risk 
analysis.  The  only  difference  is  in  the  way  that  an  analyst 
supplies  information  about  the  uncertainty  in  subcomponents 
and  bow  this  information  is  used  to  make  probability 
statements.  The  complexity  of  the  calculations  required  make 
the  use  of  a  computer  almost  a  necessity. 

Most  computer  programs  available  to  assist  an  analyst  in 
performing  calculations  required  in  a  risk  analysis  are 
designed  with  a  particular  area  of  application  in  mind  or 
require  a  relationship  between  the  different  variables 
involved  to  be  defined  in  advance.  Either  of  these 
requirements  limit  the  flexibility  of  the  software  and  hence 
applications. 

The  computer  program  discussed  in  this  report  was 
designed  such  that: 

o  no  formal  training  is  required  on  the  modeling 
technique  employed, 

o  no  mathematical  equations  need  to  be  defined, 
o  the  operation  is  similar  to  a  calculator,  and 
o  the  results  can  be  displayed  immediately. 

The  program  can  be  used  in  numerous  areas  of 
applications  including,  but  not  limited  to,  quality  control, 
scheduling,  inventory  control,  and  cost  analysis. 

INTERACTIVE  MODEL 


The  computer  program  being  discussed,  accepts  three 
estimates  for  each  subcomponent  and  allows  the  user  to 
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instructions  should  be  followed: 

1.  Turn  on  the  machine. 

2.  Insert  Diskette. 

3.  Respond  to  the  quest 
for  the  drive  number  \ 

4.  To  the  prompt  A>  type 

5.  Make  sure  the  shift  I 
must  be  in  oapital  let 

6.  To  the  prompt  OK,  typ< 

7.  To  the  prompt  OK,  typ< 
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documentation  for  1 
the  question,  "Do  you 
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user  for  the  necessi 
possible  oboices  in  pi 

In  order  to  Illustrate  tl 
example  will  be  used.  The  pro 
together  and  then  to  multiply  1 
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2  •  100 

3  .1 


The  aotual  input  and  out 
The  use  of  the  STO  command  w 
bow  intermediate  calculations  o 
portion  is  the  user  input. 


EXAMPLE 


It  order  to  execute  the  interactive  risk  pro gras,  these 
instructions  should  be  followed: 

1.  Turn  on  the  sachine. 

2.  Insert  Diskette. 

3.  Respond  to  the  question  on  the  screer  which  asks 
for  the  drive  nuaber  (usually  A). 

A.  To  the  prompt  A>  type  MB ASIC. 

5.  Make  sure  the  shift  key  is  locked  down  (all  input 
oust  be  in  capital  letters). 

6.  To  the  pronpt  OK,  type  LOAD  "RISK.BAS". 

7.  To  the  prompt  OK,  type  RUN  to  begin  the  program. 

8.  At  this  point,  the  computer  will  display 

documentation  for  the  program,  followed  by 

the  question,  "Do  you  want  instructions?"  If  you 
type,  "YES",  a  brief  explanation  of  the  commands 
will  appear.  A  brief  waiting  period  will 

follow  while  the  computer  is  loading  the 
necessary  tables  to  begin  the  calculations. 

8.  From  this  point  on,  the  computer  will  prompt  the 
user  for  the  necessary  command  by  showing  the 
possible  choices  in  parentheses. 

In  order  to  illustrate  these  instructions,  a  simple 
example  will  be  used.  The  problem  is  to  add  two  variables 
together  and  then  to  multiply  by  a  third  variable.  The  data 
for  the  three  variables  is  shown  below. 


Variable 

Low 

Most  Likely 

High 

1 

300 

too 

600 

2  ' 

100 

300 

900 

3 

.1 

.3 

.5 

The  actual  input  and  output  is  shown  on  the  next  page. 
The  use  of  the  STO  command  was  used  only  to  demonstrate 
how  intermediate  calculations  can  be  stored.  The  underlined 


portion  is  the  user  input 


COMMAND  (mul,  add,  sub,  dis,  inp,  sto,  rcl,  con,  bye) 

?  12LE 

Low,  Most  Likely,  and  High?  300.400.600 

COMMAND  (mul,  add,  sub,  dis,  inp,  sto,  rcl,  con,  bye) 
?  ADD 

COMMAND  (inp,  rcl)?  IH£ 

Low,  Most  Likely,  and  High?  100. 300.000 

COMMAND  (mul,  add,  sub,  dis,  inp,  sto,  rcl,  con,  bye) 
?  STO 

Enter  Numeric  Storage  Location?  21 

COMMAND  (mul,  add,  sub,  dis,  inp,  sto,  rcl,  con,  bye) 
?  INP 

Low,  Most  Likely,  and  High?  . 1 . . 3. .5 

COMMAND  (mul,  add,  sub,  dis,  inp,  sto,  rcl,  con,  bye) 
?  MIL 

COMMAND  (inp,  rcl)? 

Enter  Numeric  Storage  Location?  21 

COMMAND  (mul,  add,  sub,  dis,  inp,  sto,  rcl,  con,  bye) 
?  JUS 


PROBABILITY 
OF  EXCEEDING 
0.01 
0.05 
0.10 
0.15 
0.20 
0.25 
0.3  0 
0.35 
0.40 
0.45 
0.50 
0.55 
0.60 
0.65 
0.70 
0.75 
0.80 
0.85 
0.90 
0.95 
0.99 


TOTAL 

VALUE 

5.0238730D+02 
4.1390276D+02 
3.6897600D+02 
3. 3972252D+02 
3*  17157330+02 
2.9832728D+02 
2.8186660D+02 
2.6701941D+02 
2.5331504D+02 
2.40432960+02 
2.2813737D+02 
2.1624097D+02 
2.0458262D+02 
1.9301027D+02 
1.8136491D+02 
1.6945995D+02 
1. 570471 6D+02 
1.4374557D+02 
1.2885224D+02 
1. 1061040D+02 
8.8013517D+02 


Most  Likely  Value  =  1 .98077310+02 
Mean  s  2.4067632D+02 
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SUMMARY 


i 


An  interactive  risk  analysis  program,  which  is  not  tied 
to  a  particular  application  and  does  not  require  modeling 
knowledge  of  the  user,  has  been  described  in  this  paper.  The 
ability  to  perform  risk  calculations  in  a  manner  similar  to 
using  a  calculator  makes  the  program  easy  to  use  and  adds 
flexibility. 

The  program  is  currently  available  in  MBASIC  for  micro¬ 
computers  and  is  also  available  through  COPPER  IMPACT.  For 
more  information  concerning  the  program  or  its  usage  contact 
the  author  at  Pel,  Inc.,  P.  0.  Box  80784,  Baton  Rouge, 
Louisiana  70898,  or  The  Business  Research  Management  Center, 
AFBRMC/RDCB,  Wright-Patterson  AFB,  Ohio  45433. 

The  development  of  this  program  was  supported  by  the  Air 
Force  Business  Research  Management  Center. 
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STANDARDIZED  FACTORS  FOR  RISK  ANALYSIS 

I.  Introduction 

Risk  analysis  has  received  a  great  deal  of  attention  in 
the  recent  past,  especially  in  the  Department  of  Defense. 
Part  of  the  research  has  been  to  determine  the  probability 
distribution  of  the  total  cost  for  a  weapon  system.  That  is, 
the  distribution  for  what  the  total  cost  would  be  for  a 
contract,  if  reasonably  efficient  and  economical  practices 
are  maintained  in  the  contractor's  and  government's 
management  and  operation.  The  analysis  has  been  to  break  the 
total  cost  down  into  parts  which  allow  for  the  assessment  of 
the  risk  involved  and  to  combine  these  parts  to  obtain  the 
distribution  of  the  total  cost.  This  type  of  risk  analysis 
is  sometimes  referred  to  as  cost  risk  analysis. 

Cost  risk  analysis  has  in  the  past  relied  heavily  on 
subjective  estimates.  This  Introduces  several  variables  into 
the  analysis  which  make  the  results  difficult  to  Interpret. 
Such  things  as  analyst's  experience  and  personal  biases  lead 
to  results  which  are  difficult  to  substantiate  and  are 
therefore  often  disregarded. 

In  a  cost  risk  analysis  for  a  major  weapon  system, 
there  are  several  characteristics  of  a  contract  which 
indicate  the  extent  of  the  cost  risk.  Although  these  have 
always  been  recognized,  the  degree  to  which  they  introduce 
risk  in  a  contract  has  varied  greatly. 

The  purpose  of  this  paper  is  to  present  the  results  of 
research  aimed  at  capturing  the  objective  characteristics  of 


a  contract  which  introduce  coat  risk.  This  is  accomplished  by 
defining  standardized  factors  associated  with  each  of  the 
objective  characteristics  and  applying  these  factors  to  a 
cost  breakdown.  Using  statistical  theory,  the  distribution 
of  total  cost  is  then  estimated. 

The  use  of  standardized  factors  has  several  advantages 
over  subjective  estimates  of  risk.  These  include: 

o  The  cost  risk  analysis  is  objective  rather  than 
subjective. 

o  Estimates  of  risk  are  independent  of  biases  and 
experience. 

o  Risk  analysis  results  are  comparable  between 
contracts.  . 

o  Standardized  factors  provide  documentation  for  the 
cost  risk  analysis. 

o  Oversights  are  eliminated. 

o  Standardized  factors  allow  for  the  Incorporation 
of  many  different  points  of  view. 

A  model  which  utilizes  standardized  factors  is 
discussed  in  the  next  section. 


II.  Standardized  Factor  Model 

The  standardized  factor  model  discussed  here  takes  a 
Most  Likely  cost  estimate  of  subcomponent  costs  and  overhead 
factors  and  applies  risk  factors  determined  by  objective 
characteristics  of  a  contract  to  determine  the  distribution 
of  the  total  cost.  This  section  presents  a  cost  breakdown, 
standardized  factors  based  on  contract  characteristics  and 


the  application  of  these  factors  to  the  cost  elements 


The  total  cost  breakdown  used  in  this  model  is  shown  in 
Table  1.  The  material  breakdown  was  chosen  because  of  the 
differing  amounts  of  risk  for  raw  materials,  purchased  parts, 
and  subcontracted  material.  The  material  and  interdivisional 
transfer  dollars  were  further  broken  out  by  the  type  of 
Purchase  Order  (PO)  in  effect  at  the  time  of  the  analysis. 
This  breakdown  is  according  to  the  dollars  in  each  of  the 
following  categories: 

o  No  purchase  Order  issued 

o  Purchase  Order  issued  as  fixed  price 

o  Purchase  Order  Issued  as  Incentive  contract 

o  Purchase  Order  issued  as  cost  type  contract 

Only  raw  material  was  further  subdivided  into  critical  and 
non-crltical  material.  The  critical  material  prices  were 
considered  to  be  much  more  volatile  and  hence  introduces  more 
risk. 

The  cost  estimates  for  this  model  are  the  Most  Likely 
cost  and  overhead  factors  for  the  contract  under 
consideration  (Table  1).  This  along  with  some  objective 
characteristics  constitute  the  elements  of  a  contract  from 
which  the  risk  analysis  is  performed.  The  specific 
standardized  factors  used  are  based  on  the  objective 
characteristics  of  a  contract  as  shown  in  Tables  2  and  3. 
Note  that  both  Low  and  High  values  are  given  for  each  of  the 
standardized  factors.  The  purpose  of  the  Low  and  High  values 
are  to  provide  a  three  point  estimate  of  each  of  the  cost 


elements. 


Table  1 
DATA  TMPOT 

(Moat  Likely  Coat) 


Material 


Raw  Material 


Purchased  Parta 


Subcontracts 


pHot  on  P. 

<  FP - P. 

|  FPI  -  P. 


Mot  on  P.  0. 

FP - P.  0. 

FPI  -  P.  0. 


’Not  on  P.  0. 
FP  —  P.  0. 
FPI  -  P.  0. 
.Coat  -  Plus 


CRITICAL  MON-CRITICAL 


Material  Overhead 


Interdlvlaional  Transfer 


Manufacturing 


Labor 


Overhead 


Engineering 


Labor 


Overhead 


General  and  Administrative 


Other  Cost 


97  1.03 


98  1.02 
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Not  on  P.  0. 
FP - ?.  0. 

Low 

.92 

High 

1.2 
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1.08 
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_^iS 

-.15 
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1.03 

1.06 
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1.03 

1.07 

1.1 

_L13 


-LSS 

1.07 

1.1 

1.15 


Table  3 

STAMDABOIZSD  FACTORS 


Non* 

Agreement  for  duration 
90}  of  duration 
80}  of  duration 
50}  of  duration 
30}  of  duration 


FPHA  negotiated 

Total  dollar  iopact  of  rat*  variance  exceeds  5}  of  proposed  cost 
Total  dollar  impact  of  rat*  variance  does  not  exceed  5}  of  proposed  cost 


Lation  a  Promoted  Inflation 
Contract  includes  SPA  clause 

No  SPA  -  mandated  Inflation  less  than  or  equal  to  field  recoocer.daticns 
No  EPA  -  mandated  Inflation  sore  than  field  recommendations 


1  year 

2  to  3  years 
4  to  5  years 
More  than  5  years 


Pirn  standards,  well  documented  learning  curves 

80}  fira  standards  less  reliable  variance  data  due  to  liaited  history 

First  production,  liaited  standards  ar.d  variance  data 

Model  shop  operation  or  FSSD.  Tool  design  not  yet  determined 


Fira  design,  10/90  mix  of  changes  and  sustaining  effort 
30/70  aix  of  changes  and  sustaining  effort 
50/50  mix  of  changes  and  sustaining  effort 

New  .program,  design  not  determined,  little  historical  basis  to  estiaatej 


v  as 


For  instance,  If  the  Host  Likely  value  for  s  cost 
element  is  $100  and  s  standardized  factor  applied  to  this 
cost  element  is  Low  «  .9  to  High  e  1.1  than  the  three  point 
estimate  for  the  oost  element  would  be  Low  e  $90,  Most  Likely 
«  $100  sad  High  a  $110.  These  Low  and  High  factors  are 
expressed  ss  percentages  of  the  Most  Likely  and  represent 
▼slues  for  which  there  is  only  s  1$  chance  of  being  lower  or 
higher,  respectively. 

The  numbers  shown  in  Tsbles  2  and  3  form  the  basis  for 
the  risk  analysis  and  show  the  importance  of  each  faotor. 
The  specific  numbers  shown  here  are  an  initial  set.  See 
Section  III  for  a  discussion  of  evolution  of  these  values. 

The  factors  given  in  Table  2,  apply  one-for-one  to  the 
cost  breakdown  shown  for  material  and  interdivisional 
transfer.  The  factors  in  Table  3  effect  more  than  one  cost 
element.  The  specific  application  of  these  factors  to  the 
cost  elements  is  shown  in  Table  t. 

The  computations  necessary  to  apply  the  factors  to  the 
cost  elements  and  then  to  determine  the  distribution  of  the 
total  cost  have  been  computerized.  The  methodology  used  is 
the  method  of  moments  C3,  53  by  which  the  individual 
distributions  of  the  cost  elements  are  combined  to  determine 
the  distribution  of  the  total  cost. 

The  computer  model  allows  the  user  to  input  the  Most 
Likely  cost  estimates  and  the  Low  and  High  for  each  factor. 
The  specific  values  for  the  Low  and  High  are  selected  from 
those  in  Tables  2  and  3  based  on  the  particular 
characteristic  of  the  contraot.  The  other  value  need  not  be 

h-t 


Table 


entered.  This  nsthod  of  input  was  chosen  to  avoid  imbedding 
the  standardized  factors  into  the  computer  program  and  hence 
fixing  them  at  a  single  point  of  time. 

III.  Application 

There  are  several  topics  which  should  be  addressed  when 
a  standardized  factor  model  is  being  discussed.  These  topics 
are: 

o  Row  should  the  model  be  applied? 

o  How  should  the  results  be  interpreted? 

o  How  could  the  model  be  improved  in  the  future? 

The  application  of  the  model  presented  here  can  be  of 
most  benefit  in  two  areas.  The  first  is  in  the  documentation 
and  capturing  of  the  risks  involved  in  a  contract.  The 
utilization  of  this  information  can  provide  a  means  of 
demonstrating  the  amount  of  risk  involved  and  provide  support 
for  negotiation  targets  set  in  pre-negotiation  briefings. 
The  second  area  of  application  is  in  . the  area  of  structuring 
Incentive  contracts  [?]•  A  discussion  of  this  application  is 
presented  in  Appendix  A. 

When  management  is  presented  with  the  results  of  a  risk 
analysis i  they  should  be  concerned  with  several  underlying 
assumptions.  Namely: 

o  What  factors  have  bten  considered? 

o  To  what  extent  do  these  factors  affect  risk? 

o  How  do  these  results  compare  with  other  risk 

analysis?. 


IV.  Example 


The  computer  model  is  currently  progressed  in  MBASIC 
end  is  available  for  e  DEC- Rainbow  100  siorocomputer.  It  is 
executed  by: 

1.  Turn  on  the  aechine. 

2.  Insert  Diskette. 

3.  Despond  to  the  question  on  the  screen  which  esks 
for  the  drive  nuaber  (usuelly  A). 

A.  To  the  prompt  A>  type  MBASIC. 

5.  Meke  sure  the  shift  key  is  locked  down  (ell  input 
must  be  in  cepitel  letters). 

6.  To  the  prompt  OR,  type  LOAD  "RISRFAC.BAS". 

7.  To  the  prompt  OR,  type  RON.  From  this  point  on  the 
computer  will  prompt  the  user  for  the  Most  Likely 
Costs  end  the  stenderdized  fectors.  At  the  end  of 
eech  line  requiring  more  than  one  number,  the 
specific  number  of  entries  required  is  shown.  These 
numbers  must  separated  by  commas.  For  instance,  the 
prompt  for  the  purchased  parts  is: 

PURCHASED  PARTS  (6#S)7  The  user  should  type: 

.92, 1.2, .95,1. 05, .98, 1.02 

8.  After  all  of  the  input  has  been  entered,  the  Low, 
Most  Likely  and  High  Values  are  printed  for  each  of 
the  oost  elements  after  applying  the  standardized 
factors  according  to  Table  A. 

9.  The  distribution  of  the  total  cost  is  then  printed. 

A  specific  set  of  data  has  been  used  for  presenting  the 

form  of  the  input  and  output.  See  appendix  B. 


V.  Summary 


The  model  presented  In  this  paper  is  an  attempt  to 
objectively  measure  the  cost  risk  in  a  contract.  The  success 
of  this  model  will  depend  on  the  extend  to  which  the  factors 
are  modified  as  additional  information  is  acquired. 

Management  should  be  made  aware  of  the  specific  factors 
included,  the  level  of  risk  associated  with  each  factor,  and 
how  the  factors  are  applied  to  Most  Likely  cost  estimates  to 
obtain  the  total  cost  risk.  This  will  facilitate  the  use  of 
the  model  and  the  understanding  of  the  results.  As 
management  becomes  accustomed  to  this  type  of  analysis,  they 
will  be  able  to  evaluate  the  cost  risk  in  a  contract,  and 
possibly  be  able  to  suggest  future  improvements. 
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Appendix  A  [7] 


The  results  of  a  cost  risk  analysis  is  the  probability 
of  exceeding  different  total  costs  for  a  contract.  Numerous 
methods  are  available  for  the  determination  of  these 
probabilities  [1,  3,  4,  5,  6].  An  example  end-product  of  a 
risk  analysis  is  presented  in  Figure  1. 


In  this  example,  there  is  a  If  probability  of  exceeding 
1.1  million  and  the  most  likely  total  cost  is  $1  million.  In 
other  words,  there  is  a  If  probability  of  a  lOf  (1.1M)  over 
run  or  a  5f  (.95M)  under  run  of  the  most  likely  total  cost. 
The  variation  between  .95  and  1.1  million  is  not  under  the 
control  of  either  the  contractor  or  the  government. 
Contractor  efficiency  in  the  establishment  of  distribution 
shown  has  been  assumed  at  a  given  level.  Improved  or 
superior  performance  will  cause  a  shift  of  the  curve  to  the 
left  or  right  but  not  change  the  risk  involved. 

Two  contract  types  are  discussed  here.  The  first  is  a 
Firm  Fixed  Price  (FFP).  For  a  FFP  contract  the  price  is  set 
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at  a  fixed  value  at  the  time  of  negotiations.  Any  over  runs 
or  under  runs  are  absorbed  by  the  contractor.  The  price 
negotiated  is  the  total  obligation  of  the  governnent.  The 
second  contract  type  is  more  complicated  in  that  several 
factors  must  be  negotiated.  A  Fixed  Price  Incentive  (FPI) 
contract  is  a  way  of  tieing  profit  to  cost.  A  target  cost 
and  target  profit  are  established  along  with  a  share  ratio 
and  a  celling  cost.  A  FPI  contract  is  illustrated  below  in 
Figure  2. 


In  this  example,  if  the  cost  at  the  end  of  the  contract 
is  equal  to  the  Target  Cost,  then  the  contractor  is  paid  the 
Target  Profit.  If  the  cost  over  runs  or  under  runs  the 
Target  Cost,  then  the  government  will  pick  up  "a)”  and  the 
contractor  will  have  "b?"  additional  or  less  profit.  At  the 
"point  of  total  assumption",  the  contractor  will  pay  100?  of 
any  excessive  cost  from  profit.  The  ceiling  price  is  the 
maximum  government  obligation.  Note  that  the  "Total  Prioe" 
is  equal  to  the  oost  plus  profit. 


II 


A  contract  vith  estimated  cost  as  shown  in  Figure  1  is 
a  candidate  for  use  of  an  incentive  contract.  Generally 
speaking  Incentive  contracts  have  been  written  so  that  they 
offer  the  contractor  a  real  incentive  to  sect  or  better  the 
cost  objectives  of  a  contract  (the  target  cost).  An 
incentive  contract  also  offers  the  contractor  rewards 
coonensurate  with  the  risks  he  assumes. 

A  FFP  type  of  contract  usually  incorporates  a  premium 
for  the  risk.  The  sharing  of  risk  is  negotiated  at  the  time 
of  writing  the  contract  rather  than  based  on  the  outcome  of 
total  cost  as  in  an  incentive  contract. 

Both  the  FFI  and  FFP  contract  structures  are  discussed 
in  great  detail  in  the  Incentive  Contracting  Guide  [  2  ].  The 
discussion  which  follows  shows  how  an  incentive  contract  and 
fixed  price  contracts  can  be  structured  from  information 
obtained  from  a  cost  risk  analysis. 

Figure  3t  and  5  give  examples  of  different  amounts 
of  risk  and  shows  the  appropriate  contract  type  for  each. 
That  is,  if  the  risk  is  small  a  FFP  contract  is  appropriate; 
if  the  risk  is  in  a  medium  range  then  a  FPI  contract  is 
appropriate;  and  if  the  risk  is  large,  then  a  Cost  Plus  Fixed 
Fee  (CPFE)  contract  is  appropriate. 

The  structuring  of  a  fixed  price  contract  is  achieved 
by  taking  expeoted  cost  and  adding  target  profit.  Since 
there  is  a  small  amount  of  risk,  the  fixed  price  will  provide 
profit  for  the  contractor  over  the  entire  range  of  cost. 
Furthermore,  the  amount  paid  by  the  government  is  fixed.  If 
the  procedure  given  below  for  incentive  contracts  is  used, 

11-16 


M 


•jr 


££££ 


the  governaent's  share  would  bo  olaost  zero.  In  Piguro  3, 
tho  straight  lino  roprosonta  tho  trado  off  botwoon  cost  and 
profit  laposed  bp  a  FFP  contract. 


Piguro  4  places  on  a  single  graph  the  probability  of 
exceeding  different  costs  and  an  PPI  contract  structure. 
Currently  the  target  cost  being  used  in  structuring  incentive 
contracts  is  the  expected  total  cost  from  the  risk  analysis. 
The  Target  Profit  is  established  using  the  Weighted 
Guidelines  which  incorporates  a  factor  for  risk.  The 
Warranted  Profit  is  the  Target  Profit  less  the  risk  factor. 
The  point  of  total  assuaption  is  currently  assuaed  to  be  the 
cost  for  which  there  is  only  a  1$  chance  of  exceeding.  Each 
of  these  points  are  identified  in  Figure  4.  The  Share  Ratio 
can  then  be  calculated  as: 

Tareafc  -  Warranted 

Share  Ratio  a  1}  Cost  -  Target  Cost 
The  ceiling  cost  is  then: 

Celling  Cost  •  If  Cost  ♦  Warranted  Profit 


Tha  thought  process  uud  la  Baking  the  ehoicos  of 
Tar gat  Cost  and  ths  point  of  total  assuaption  war*  that  tbo 
targst  profit  should  b«  an  average  profit  ratbar  than  a  aost 
likaly  profit  and  thus  should  ba  basad  on  tha  axpaotad  cost. 
Furtheraore,  dua  to  tha  coaaon  skewness  of  tha  total  cost 
distribution  tha  expected  would  be  s  aore  conservative 
estlaate  of  tha  resulting  total  cost.  Tha  warranted  profit 
is  tha  desired  profit  if  all  risk  is  reaoved.  Here  we  assume 
that  a  probability  of  \%  of  exceeding  has  removed  the  risk. 

For  a  cost  type  contract,  tha  risk  is  so  great  that  the 
government's  share  is  approximately  100J.  Figure  5  would 
imply  that  the  entire  coat  is  paid  by  the  government  and  the 
contractor's  fee  is  not  based  on  the  amount  of  cost. 


This  appendix  hat  triad  to  show  the  importance  of  using 
risk  analysis  in  the  structuring  of  incentive  type  contracts. 
Probabilities  from  a  risk  analysis  such  as  the  ones  shown  in 
Figure  1  can  be  used  to  build  a  case  for  a  particular 
contract  type  and  to  develop  targetsi  shares  and  ceilings. 
It  is  important  to  uae  good  Judgment  concerning  the  eontraot 
structure  and  to  uae  risk  analysis  aa  only  one  input  into  the 
decision  making  process. 


Appendix  B 


Saaple  Run 

In  order  to  Illustrate  the  program  for  standardized 
factors  in  a  risk  analysis,  a  saaple  run  using  a  specific  set 
of  data  Is  presented  on  the  next  two  pages.  The  Most  Likely 
Cost  Estiaates  were  entered  first,  followed  by  the  factors 
which  were  obtained  fros  Tables  2  and  3  of  this  report.  The 
actual  input  and  output  are  shown  in  this  appendix.  The  user 
input  portions  are  underlined. 
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MOST  LUELT  COST  ESTIMATES 

RAH  MATERIAL  -  NOT  OH  P  0  (CRITICAL  AND  MOM-CRITICAL  H2»S)?  0.2100 
RAH  MATERIAL  -  PP  -  P  0  (CRITICAL  AND  H0N-CRITICAL)(2»3)?  0,2100 
RAH  MATERIAL  -  PPI  -  P  0  (CRITICAL  AND  MOM-CRITICAL)  (2»S)?  0,0 
PURCHASED  PARTS  (NOT  ON  P  0,  PP  -  P  0,  PPI  -  P  0)  (3#S)? ,21QflLfl*Q. 
SUBCONTRACT  (NOT  P  0,  PP  -  P  0,  PPI  ■  P  0,  C0STH4*S1?  0.0. 0.0 
MATERIAL  0  H?  .05 

INTERDIVISIONAL  TRANS  (NOT  P  0,  PP  -  P  0,  PPI  -  P  0,  C0ST)(4#S)? 

MANUFACTURING  LABOR?  2200 

MANUFACTURING  OVERHEAD?  1.50 

ENGINEERING  LABOR?  200 

ENGINEERING  OVERHEAD?  1.02 

G  A  A?  .05 

OTHER  COST?  .0 


FACTOR  INPUT 

R.M.  NOT  P  0  (4*3)7  .9. 1.2. .92. 1.15 

R.M.  PP-P  0  (4»S)7  .97, 1.03,. 98, 1.02 

R.M.  PPI-  P  O(4»S)?~T97,1.03,.9et1.'F2 

PURCHASED  PARTS  (6*S)?  .92.1.2, .9$, 1. fc, .98, 1.02 

SUBCONTRACT  (8#S)7  .95. 1 .2. . 95, 1 .05, . 98, 1 .02, . 95 , 1 . 1 

I.T. (8»S)7  .95, 1 .2. *795. 1 .05. .98, 1 .02,. 95. 1 . 1  " 

UNION?  .96,T7o8~ 

FPRA?  .98,1.02 
INFLATION?  .97.1.03 
PERIOD?  .88.1.12 
STANDARDS?  .93.1.15 
DESIGN?  .93,1.15 


MATERIAL 

LOU 

5566.64417931 1^21 

M.L. 

6358.09418399163 

HIGH 

7275.821813992257 

MAT.  O.H. 

LOW 

1.029847185704748 

M.L. 

1.049444370878843 

HIGH 

1.07159889554489.' 

I.T. 

LOW 

1511.257444317504 

M.L. 

1717.027118581446 

HIGH 

2105.22490487645- 

MGT.LAB. 

LOW 

1886.121254027108 

M.L. 

2246.495793508889 

HIGH 

2826 . 59842681 395< 

SNGR.  LAB. 

LOW 

171.5284067229302 

M.L. 

202.778763065192 

HIGH 

252.6514798419583 

MGT.  O.H. 

LOW 

2.452336963029737 

M.L. 

2.498388484843897 

HIGH 

2.55183826429185'. 

ENGR.  0.  H. 

LOW 

1.995934713350177 

M.L. 

2.005370273205126 

HIGH 

2.07637889931253' 

G  AA 

LOW 

1.029847185704748 

M.L. 

1.049444370878843 

HIGH 

1.07159889554439: 

OTHER  CONSTANT  0 

PROBABILITY  TOTAL  Most  Likely  Value  s  1 .5243031 0+04 

OF  EXCEEDING  VALUE  Mean  a  1.53110710+04 


0.01 

1.7074890+04 

0.05 

1. 6558890+04 

0.10 

1.627939D+04 

0.15 

1.6089530+04 

0.20 

1.5938150+04 

0.25 

1.5808120+04 

0.30 

1.569136D+04 

0.35 

1.5583310+04 

0.40 

1.5481030+04 

0.45 

1.5382440+04 

0.50 

1 . 528588D+04 

0.55 

1.5189940+04 

0.60 

1 . 5093230+04 

.  0.65 

1.499429D+04 

0.70 

1.4891380+04 

0.75 

1.4782190+04 

0.80 

1.4663330+04 

0.85 

1.4529110+04 

0.90 

1.436815D+04 

0.95 

1.414938D+04 

0.99 

1.381764D+04 

J.f, 


